User interface for remote joint workout session

ABSTRACT

Example embodiments relate to a system, method, apparatus, and computer readable media configured to generate a multiple renditions of a user interface that is updated based upon athletic movements of two or more users remotely located from each other. The UI may be configured to simultaneously display energy expenditure values in real-time. In further embodiments, a joint energy expenditure values determined from multiple remote users may be simultaneously displayed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. patent application Ser. No.13/664,251, filed Oct. 30, 2012, which is a continuation-in-part of U.S.patent application Ser. No. 13/324,812, filed Dec. 13, 2011; and acontinuation-in-part application of U.S. patent application Ser. No.13/304,056, filed Nov. 23, 2011, now U.S. Pat. No. 9,223,936; and acontinuation-in-part application of U.S. patent application Ser. No.13/290,478, filed Nov. 7, 2011, now U.S. Pat. No. 9,358,426; and acontinuation-in-part of U.S. patent application Ser. No. 13/290,359,filed Nov. 7, 2011, now U.S. Pat. No. 9,283,429; and acontinuation-in-part application of U.S. patent application Ser. No.13/304,064, filed Nov. 23, 2011, now U.S. Pat. No. 9,457,256. Thisapplication also claims the benefit of, and priority to U.S. ProvisionalPatent Application Ser. No. 61/655,365 filed Jun. 4, 2012. The contentsof each of the above-identified applications are expressly incorporatedherein by reference in their entireties for any and all non-limitingpurposes.

BACKGROUND

While most people appreciate the importance of physical fitness, manyhave difficulty finding the motivation required to maintain a regularexercise program. Some people find it particularly difficult to maintainan exercise regimen that involves continuously repetitive motions, suchas running, walking and bicycling.

Additionally, individuals may view exercise as work or a chore and thus,separate it from enjoyable aspects of their daily lives. Often, thisclear separation between athletic activity and other activities reducesthe amount of motivation that an individual might have towardexercising. Further, athletic activity services and systems directedtoward encouraging individuals to engage in athletic activities mightalso be too focused on one or more particular activities while anindividual's interest are ignored. This may further decrease a user'sinterest in participating in athletic activities or using the athleticactivity services and systems.

Therefore, improved systems and methods to address these and othershortcomings in the art are desired.

BRIEF SUMMARY

The following presents a simplified summary in order to provide a basicunderstanding of some aspects of the disclosure. The summary is not anextensive overview of the disclosure. It is neither intended to identifykey or critical elements of the disclosure nor to delineate the scope ofthe disclosure. The following summary merely presents some concepts ofthe disclosure in a simplified form as a prelude to the descriptionbelow.

Aspects of this disclosure relate to processing of data taken while auser performs an athletic activity to determine an estimate of energyexpenditure such as, for example, an amount of calories burned.

Example embodiments may relate to a system, method, apparatus, andcomputer readable media configured for prompting a user to perform anexercise and calculating an energy expenditure estimate for the userperforming the exercise. This may be based on a type of the exerciseand/or on the form of the user. In other embodiments, expenditureestimate may be, or comprise, for example, an estimate of caloriesburned by the user. In certain embodiments, energy expenditurecalculations comprise determinations relating to: effort, oxygenconsumed, and/or oxygen kinetics of the user.

Certain aspects of this disclosure relate to a graphical user interface(UI) configured to facilitate a joint session of two or more remoteusers. Despite being at different physical locations, users may stillcompete and/or collectively engage in athletic activities. In oneembodiment, each of a plurality of users may engage in a competition insubstantially real-time. Thus, aspects of this disclosure relate tosystem and methods that may simultaneously present a UI on two remotedisplay devices in which the users may conduct a joint session despitebeing remotely located. Virtual trainer renditions may be configured tosimultaneously prompt the remote users to perform a specific exercise.For example, one or more devices may cause the respective displays topresent a virtual trainer rendition demonstrating an exercise toinstruct the users.

Further aspects of this disclosure relate to generating and updating aUI based upon real-time fitness or movement data obtained from two ormore users that are located at different locations. In certainembodiments, the local UI rendition may only show the graphicalrepresentation of the local user inclusive of any adjustments based uponthe user's real-time movements and not other graphical representationsof other remote users. Certain embodiments may be configured tosimultaneous display real-time image data of a plurality of usersassociated with the joint session on a single display device.

Calculated energy expenditure determinations based upon the respectiveusers' real-time performances may be simultaneously displayed on a userinterface. In certain embodiments, interface renditions may be updatedin real-time to reflect values (such as an energy expenditure value)associated with the respective movements of users responsive to theinstructions provided by virtual one or more trainers. Thus, accordingto certain implementations, a plurality of users may readily view notonly which user has the highest value, or the energy expended per unittime, but also determine how close the other user's value is to theirs,whether the other user(s) are getting closer or further, and/ordeterminations relating to other users performances on specificroutines. Still yet further embodiments, an interface may be configuredto display a joint total of points determined from the joint movementsof at least two users.

Further aspects of this disclosure relate to selecting and displaying ameter on a user interface. In certain embodiments, a meter may beselected from a plurality of meters. The selected meter for an attributeof a first user's performance may be simultaneous displayed on multiplerenditions of UI.

The meter(s) may be updated in real-time as the users perform thepredetermined athletic activity. Thus in certain embodiments, each of aplurality of users remotely located from at least one other user maycompare their performance with at least one other user. The updating ofthe meter(s) may be based upon sensor data, such as described herein. Inone embodiment, the properties of at least the first selected meter maybe based upon data received from the at least one sensor located at thefirst location and simultaneously altering the properties of the secondselected meter based upon data received from the at least one sensor atthe second location.

These and other aspects of the embodiments are discussed in greaterdetail throughout this disclosure, including the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure is illustrated by way of example and not limitedin the accompanying figures in which like reference numerals indicatesimilar elements and in which:

FIGS. 1A-C illustrate an example of a system for providing personaltraining in accordance with example embodiments, wherein FIG. 1Aillustrates an example network configured to monitor athletic activity,FIG. 1B illustrates an example computing device in accordance withexample embodiments, and FIG. 1C illustrates example sensory locationsthat may be utilized for monitoring user performance during physicalactivity in accordance with example embodiments;

FIG. 2 illustrates an example sensor assembly that may be worn by a userin accordance with example embodiments;

FIG. 3 illustrates another example sensor assembly that may be worn by auser in accordance with example embodiments;

FIGS. 4A-B illustrate an example user interface that may be implementedin accordance with example embodiments, wherein FIG. 4A shows a firstrendition of the user interface and FIG. 4B shows a second rendition ofthe interface which may be simultaneously displayed to a remote user ina remote location;

FIG. 5 is a flowchart of an example method that may be utilized toconduct a joint workout session between multiple remote users inaccordance with an example embodiment;

FIG. 6 provides an example UI interface that may be utilized to provideform guidance in accordance with on exemplary embodiment;

FIG. 7 is a flowchart of an exemplary method of selecting and updating ameter in accordance with one embodiment; and

FIGS. 8A-B shows example meters that may be utilized in accordance withvarious embodiments disclosed herein. Specifically, FIG. 8A shows anexample cardio meter 802 and FIG. 8B shows an example strength meter804.

DETAILED DESCRIPTION

In the following description of the various embodiments, reference ismade to the accompanying drawings, which form a part hereof, and inwhich is shown by way of illustration various embodiments in which thedisclosure may be practiced. It is to be understood that otherembodiments may be utilized and structural and functional modificationsmay be made without departing from the scope and spirit of the presentdisclosure. Further, headings within this disclosure should not beconsidered as limiting aspects of the disclosure. Those skilled in theart with the benefit of this disclosure will appreciate that the exampleembodiments are not limited to the example headings.

I. Example Personal Training System

A. Illustrative Computing Devices

FIG. 1A illustrates an example of a personal training system 100 inaccordance with example embodiments. Example system 100 may include oneor more electronic devices, such as computer 102. Computer 102 maycomprise a mobile terminal, such as a telephone, music player, tablet,netbook or any portable device. In other embodiments, computer 102 maycomprise a set-top box (STB), desktop computer, digital videorecorder(s) (DVR), computer server(s), and/or any other desiredcomputing device. In certain configurations, computer 102 may comprise agaming console, such as for example, a Microsoft® XBOX, Sony®Playstation, and/or a Nintendo® Wii gaming consoles. Those skilled inthe art will appreciate that these are merely example consoles fordescriptive purposes and this disclosure is not limited to any consoleor device.

Turning briefly to FIG. 1B, computer 102 may include computing unit 104,which may comprise at least one processing unit 106. Processing unit 106may be any type of processing device for executing softwareinstructions, such as for example, a microprocessor device. Computer 102may include a variety of non-transitory computer readable media, such asmemory 108. Memory 108 may include, but is not limited to, random accessmemory (RAM) such as RAM 110, and/or read only memory (ROM), such as ROM112. Memory 108 may include any of: electronically erasable programmableread only memory (EEPROM), flash memory or other memory technology,CD-ROM, digital versatile disks (DVD) or other optical disk storage,magnetic storage devices, or any other medium that can be used to storethe desired information and that can be accessed by computer 102.

The processing unit 106 and the system memory 108 may be connected,either directly or indirectly, through a bus 114 or alternatecommunication structure to one or more peripheral devices. For example,the processing unit 106 or the system memory 108 may be directly orindirectly connected to additional memory storage, such as a hard diskdrive 116, a removable magnetic disk drive, an optical disk drive 118,and a flash memory card. The processing unit 106 and the system memory108 also may be directly or indirectly connected to one or more inputdevices 120 and one or more output devices 122. The output devices 122may include, for example, a display device 136, television, printer,stereo, or speakers. In some embodiments one or more display devices maybe incorporated into eyewear. The display devices incorporated intoeyewear may provide feedback to users. Eyewear incorporating one or moredisplay devices also provides for a portable display system. The inputdevices 120 may include, for example, a keyboard, touch screen, a remotecontrol pad, a pointing device (such as a mouse, touchpad, stylus,trackball, or joystick), a scanner, a camera or a microphone. In thisregard, input devices 120 may comprise one or more sensors configured tosense, detect, and/or measure athletic movement from a user, such asuser(s) 124/125, shown in FIG. 1A. As used herein, an “athleticmovement” includes movements relating to fitness, exercise, flexibility,including movements that may be part of one or more single and multipleparticipant athletic competitions, exercise routines, and/orcombinations thereof. Further although one user is shown to representmultiple users (e.g., 124/125), those skilled in the art will appreciatethat user 124 and 125 are not required to, but may, have one or more ofthe same types of sensors. Further, one or more users 124/125 may belocated at remote locations from each other.

Looking again to FIG. 1A, image-capturing device 126 and/or sensor 128may be utilized in detecting and/or measuring athletic movements of user124. In one embodiment, data obtained from image-capturing device 126 orsensor 128 may directly detect athletic movements, such that the dataobtained from image-capturing device 126 or sensor 128 is directlycorrelated to a motion parameter. For example, and with reference toFIG. 4, image data from image-capturing device 126 may detect that thedistance between sensor locations 402 g and 402 i has decreased andtherefore, image-capturing device 126 alone may be configured to detectthat user's 124 right arm has moved. Yet, in other embodiments, datafrom image-capturing device 126 and/or sensor 128 may be utilized incombination, either with each other or with other sensors to detectand/or measure movements. Thus, certain measurements may be determinedfrom combining data obtained from two or more devices. Image-capturingdevice 126 and/or sensor 128 may include or be operatively connected toone or more sensors, including but not limited to: an accelerometer, agyroscope, a location-determining device (e.g., GPS), light sensor,temperature sensor (including ambient temperature and/or bodytemperature), heart rate monitor, image-capturing sensor, moisturesensor and/or combinations thereof. Example uses of illustrative sensors126, 128 are provided below in Section I.C, entitled “IllustrativeSensors.” Computer 102 may also use touch screens or image capturingdevice to determine where a user is pointing to make selections from agraphical user interface. One or more embodiments may utilize one ormore wired and/or wireless technologies, alone or in combination,wherein examples of wireless technologies include Bluetooth®technologies, Bluetooth® low energy technologies, and/or ANTtechnologies.

B. Illustrative Network

Still further, computer 102, computing unit 104, and/or any otherelectronic devices may be directly or indirectly connected to one ormore network interfaces, such as example interface 130 (shown in FIG.1B) for communicating with a network, such as network 132. In theexample of FIG. 1B, network interface 130, may comprise a networkadapter or network interface card (NIC) configured to translate data andcontrol signals from the computing unit 104 into network messagesaccording to one or more communication protocols, such as theTransmission Control Protocol (TCP), the Internet Protocol (IP), and theUser Datagram Protocol (UDP). These protocols are well known in the art,and thus will not be discussed here in more detail. An interface 130 mayemploy any suitable connection agent for connecting to a network,including, for example, a wireless transceiver, a power line adapter, amodem, or an Ethernet connection. Network 132, however, may be any oneor more information distribution network(s), of any type(s) ortopology(s), alone or in combination(s), such as internet(s),intranet(s), cloud(s), LAN(s). Network 132 may be any one or more ofcable, fiber, satellite, telephone, cellular, wireless, etc. Networksare well known in the art, and thus will not be discussed here in moredetail. Network 132 may be variously configured such as having one ormore wired or wireless communication channels to connect one or morelocations (e.g., schools, businesses, homes, consumer dwellings, networkresources, etc.), to one or more remote servers 134, or to othercomputers, such as similar or identical to computer 102. Indeed, system100 may include more than one instance of each component (e.g., morethan one computer 102, more than one display 136, etc.).

Regardless of whether computer 102 or other electronic device withinnetwork 132 is portable or at a fixed location, it should be appreciatedthat, in addition to the input, output and storage peripheral devicesspecifically listed above, the computing device may be connected, suchas either directly, or through network 132 to a variety of otherperipheral devices, including some that may perform input, output andstorage functions, or some combination thereof. In certain embodiments,a single device may integrate one or more components shown in FIG. 1A.For example, a single device may include computer 102, image-capturingdevice 126, sensor 128, display 136 and/or additional components. In oneembodiment, sensor device 138 may comprise a mobile terminal having adisplay 136, image-capturing device 126, and one or more sensors 128.Yet, in another embodiment, image-capturing device 126, and/or sensor128 may be peripherals configured to be operatively connected to a mediadevice, including for example, a gaming or media system. Thus, it goesfrom the foregoing that this disclosure is not limited to stationarysystems and methods. Rather, certain embodiments may be carried out by auser 124 in almost any location.

A. Illustrative Sensors

Computer 102 and/or other devices may comprise one or more sensors 126,128 configured to detect and/or monitor at least one fitness parameterof a user 124. Sensors 126 and/or 128 may include, but are not limitedto: an accelerometer, a gyroscope, a location-determining device (e.g.,GPS), light sensor, temperature sensor (including ambient temperatureand/or body temperature), sleep pattern sensors, heart rate monitor,image-capturing sensor, moisture sensor and/or combinations thereof.Network 132 and/or computer 102 may be in communication with one or moreelectronic devices of system 100, including for example, display 136, animage capturing device 126 (e.g., one or more video cameras), and sensor128, which may be an infrared (IR) device. In one embodiment sensor 128may comprise an IR transceiver. For example, sensors 126, and/or 128 maytransmit waveforms into the environment, including towards the directionof user 124 and receive a “reflection” or otherwise detect alterationsof those released waveforms. In yet another embodiment, image-capturingdevice 126 and/or sensor 128 may be configured to transmit and/orreceive other wireless signals, such as radar, sonar, and/or audibleinformation. Those skilled in the art will readily appreciate thatsignals corresponding to a multitude of different data spectrums may beutilized in accordance with various embodiments. In this regard, sensors126 and/or 128 may detect waveforms emitted from external sources (e.g.,not system 100). For example, sensors 126 and/or 128 may detect heatbeing emitted from user 124 and/or the surrounding environment. Thus,image-capturing device 126 and/or sensor 128 may comprise one or morethermal imaging devices. In one embodiment, image-capturing device 126and/or sensor 128 may comprise an IR device configured to perform rangephenomenology. As a non-limited example, image-capturing devicesconfigured to perform range phenomenology are commercially availablefrom Flir Systems, Inc. of Portland, Oreg. Although image capturingdevice 126 and sensor 128 and display 136 are shown in direct(wirelessly or wired) communication with computer 102, those skilled inthe art will appreciate that any may directly communicate (wirelessly orwired) with network 132.

Multi-Purpose Electronic Devices

User 124 may possess, carry, and/or wear any number of electronicdevices, including sensory devices 138, 140, 142, and/or 144. In certainembodiments, one or more devices 138, 140, 142, 144 may not be speciallymanufactured for fitness or athletic purposes. Indeed, aspects of thisdisclosure relate to utilizing data from a plurality of devices, some ofwhich are not fitness devices, to collect, detect, and/or measureathletic data. In one embodiment, device 138 may comprise a portableelectronic device, such as a telephone or digital music player,including an IPOD®, IPAD®, or iPhone®, brand devices available fromApple, Inc. of Cupertino, Calif. or Zune® or Microsoft® Windows devicesavailable from Microsoft of Redmond, Wash. As known in the art, digitalmedia players can serve as both an output device for a computer (e.g.,outputting music from a sound file or pictures from an image file) and astorage device. In one embodiment, device 138 may be computer 102, yetin other embodiments, computer 102 may be entirely distinct from device138. Regardless of whether device 138 is configured to provide certainoutput, it may serve as an input device for receiving sensoryinformation. Devices 138, 140, 142, and/or 144 may include one or moresensors, including but not limited to: an accelerometer, a gyroscope, alocation-determining device (e.g., GPS), light sensor, temperaturesensor (including ambient temperature and/or body temperature), heartrate monitor, image-capturing sensor, moisture sensor and/orcombinations thereof. In certain embodiments, sensors may be passive,such as reflective materials that may be detected by image-capturingdevice 126 and/or sensor 128 (among others). In certain embodiments,sensors 144 may be integrated into apparel, such as athletic clothing.For instance, the user 124 may wear one or more on-body sensors 144 a-b.Sensors 144 may be incorporated into the clothing of user 124 and/orplaced at any desired location of the body of user 124. Sensors 144 maycommunicate (e.g., wirelessly) with computer 102, sensors 128, 138, 140,and 142, and/or camera 126. Examples of interactive gaming apparel aredescribed in U.S. patent application Ser. No. 10/286,396, filed Oct. 30,2002, and published as U.S. Pat. Pub, No. 2004/0087366, the contents ofwhich are incorporated herein by reference in its entirety for any andall non-limiting purposes. In certain embodiments, passive sensingsurfaces may reflect waveforms, such as infrared light, emitted byimage-capturing device 126 and/or sensor 128. In one embodiment, passivesensors located on user's 124 apparel may comprise generally sphericalstructures made of glass or other transparent or translucent surfaceswhich may reflect waveforms. Different classes of apparel may beutilized in which a given class of apparel has specific sensorsconfigured to be located proximate to a specific portion of the user's124 body when properly worn. For example, golf apparel may include oneor more sensors positioned on the apparel in a first configuration andyet soccer apparel may include one or more sensors positioned on apparelin a second configuration.

Devices 138-144 may communicate with each other, either directly orthrough a network, such as network 132. Communication between one ormore of devices 138-144 may communicate through computer 102. Forexample, two or more of devices 138-144 may be peripherals operativelyconnected to bus 114 of computer 102. In yet another embodiment, a firstdevice, such as device 138 may communicate with a first computer, suchas computer 102 as well as another device, such as device 142, however,device 142 may not be configured to connect to computer 102 but maycommunicate with device 138. Those skilled in the art will appreciatethat other configurations are possible.

Some implementations of the example embodiments may alternately oradditionally employ computing devices that are intended to be capable ofa wide variety of functions, such as a desktop or laptop personalcomputer. These computing devices may have any combination of peripheraldevices or additional components as desired. Also, the components shownin FIG. 1B may be included in the server 134, other computers,apparatuses, etc.

2. Illustrative Apparel/Accessory Sensors

In certain embodiments, sensory devices 138, 140, 142 and/or 144 may beformed within or otherwise associated with user's 124 clothing oraccessories, including a watch, armband, wristband, necklace, shirt,shoe, or the like. Examples of shoe-mounted and wrist-worn devices(devices 140 and 142, respectively) are described immediately below,however, these are merely example embodiments and this disclosure shouldnot be limited to such.

1. Shoe-Mounted Device

In certain embodiments, sensory device 140 may comprise footwear whichmay include one or more sensors, including but not limited to: anaccelerometer, location-sensing components, such as GPS, and/or a forcesensor system. FIG. 2 illustrates one example embodiment of a sensorsystem 202. In certain embodiments, system 202 may include a sensorassembly 204. Assembly 204 may comprise one or more sensors, such as forexample, an accelerometer, location-determining components, and/or forcesensors. In the illustrated embodiment, assembly 204 incorporates aplurality of sensors, which may include force-sensitive resistor (FSR)sensors 206. In yet other embodiments, other sensor(s) may be utilized.Port 208 may be positioned within a sole structure 209 of a shoe. Port208 may optionally be provided to be in communication with an electronicmodule 210 (which may be in a housing 211) and a plurality of leads 212connecting the FSR sensors 206 to the port 208. Module 210 may becontained within a well or cavity in a sole structure of a shoe. Theport 208 and the module 210 include complementary interfaces 214, 216for connection and communication.

In certain embodiments, at least one force-sensitive resistor 206 shownin FIG. 2 may contain first and second electrodes or electrical contacts218, 220 and a force-sensitive resistive material 222 disposed betweenthe electrodes 218, 220 to electrically connect the electrodes 218, 220together. When pressure is applied to the force-sensitive material 222,the resistivity and/or conductivity of the force-sensitive material 222changes, which changes the electrical potential between the electrodes218, 220. The change in resistance can be detected by the sensor system202 to detect the force applied on the sensor 216. The force-sensitiveresistive material 222 may change its resistance under pressure in avariety of ways. For example, the force-sensitive material 222 may havean internal resistance that decreases when the material is compressed,similar to the quantum tunneling composites described in greater detailbelow. Further compression of this material may further decrease theresistance, allowing quantitative measurements, as well as binary(on/off) measurements. In some circumstances, this type offorce-sensitive resistive behavior may be described as “volume-basedresistance,” and materials exhibiting this behavior may be referred toas “smart materials.” As another example, the material 222 may changethe resistance by changing the degree of surface-to-surface contact.This can be achieved in several ways, such as by using microprojectionson the surface that raise the surface resistance in an uncompressedcondition, where the surface resistance decreases when themicroprojections are compressed, or by using a flexible electrode thatcan be deformed to create increased surface-to-surface contact withanother electrode. This surface resistance may be the resistance betweenthe material 222 and the electrode 218, 220 222 and/or the surfaceresistance between a conducting layer (e.g., carbon/graphite) and aforce-sensitive layer (e.g., a semiconductor) of a multi-layer material222. The greater the compression, the greater the surface-to-surfacecontact, resulting in lower resistance and enabling quantitativemeasurement. In some circumstances, this type of force-sensitiveresistive behavior may be described as “contact-based resistance.” It isunderstood that the force-sensitive resistive material 222, as definedherein, may be or include a doped or non-doped semiconducting material.

The electrodes 218, 220 of the FSR sensor 216 can be formed of anyconductive material, including metals, carbon/graphite fibers orcomposites, other conductive composites, conductive polymers or polymerscontaining a conductive material, conductive ceramics, dopedsemiconductors, or any other conductive material. The leads 212 can beconnected to the electrodes 218, 220 by any suitable method, includingwelding, soldering, brazing, adhesively joining, fasteners, or any otherintegral or non-integral joining method. Alternately, the electrode 218,220 and associated lead 212 may be formed of a single piece of the samematerial.

ii. Wrist-Worn Device

As shown in FIG. 3, device 326 (which may resemble or be sensory device142 shown in FIG. 1A) may be configured to be worn by user 124, such asaround a wrist, arm, ankle or the like. Device 326 may monitor athleticmovements of a user, including all-day activity of user 124. In thisregard, device 326 may detect athletic movement during user's 124interactions with computer 102 and/or operate independently of computer102. For example, in one embodiment, device 326 may be an-all dayactivity monitor that measures activity regardless of the user'sproximity or interactions with computer 102. Device 326 may communicatedirectly with network 132 and/or other devices, such as devices 138and/or 140. In other embodiments, athletic data obtained from device 326may be utilized in determinations conducted by computer 102, such asdeterminations relating to which exercise programs are presented to user124. In one embodiment, device 326 may also wirelessly interact with amobile device, such as device 138 associated with user 124 or a remotewebsite such as a site dedicated to fitness or health related subjectmatter. At some predetermined time, the user may wish to transfer datafrom the device 326 to another location.

As shown in FIG. 3, device 326 may include an input mechanism, such as adepressible input button 328 assist in operation of the device 326. Theinput button 328 may be operably connected to a controller 330 and/orany other electronic components, such as one or more of the elementsdiscussed in relation to computer 102 shown in FIG. 1B. Controller 330may be embedded or otherwise part of housing 332. Housing 332 may beformed of one or more materials, including elastomeric components andcomprise one or more displays, such as display 334. The display may beconsidered an illuminable portion of the device 326. The display 234 mayinclude a series of individual lighting elements or light members suchas LED lights 334 in an exemplary embodiment. The LED lights may beformed in an array and operably connected to the controller 330. Device326 may include an indicator system 336, which may also be considered aportion or component of the overall display 334. It is understood thatthe indicator system 336 can operate and illuminate in conjunction withthe display 334 (which may have pixel member 335) or completely separatefrom the display 334. The indicator system 336 may also include aplurality of additional lighting elements or light members 338, whichmay also take the form of LED lights in an exemplary embodiment. Incertain embodiments, indicator system may provide a visual indication ofgoals, such as by illuminating a portion of lighting members 338 torepresent accomplishment towards one or more goals.

A fastening mechanism 340 can be unlatched wherein the device 326 can bepositioned around a wrist of the user 124 and the fastening mechanism340 can be subsequently placed in a latched position. The user can wearthe device 226 at all times if desired. In one embodiment, fasteningmechanism 340 may comprise an interface, including but not limited to aUSB port, for operative interaction with computer 102 and/or devices138, 140.

In certain embodiments, device 326 may comprise a sensor assembly (notshown in FIG. 3). The sensor assembly may comprise a plurality ofdifferent sensors. In an example embodiment, the sensor assembly maycomprise or permit operative connection to an accelerometer (includingin the form of a multi-axis accelerometer), a gyroscope, a heart ratesensor, location-determining device (e.g., GPS), light sensor,temperature sensor (including ambient temperature and/or bodytemperature), heart rate monitor, image-capturing, such as a GPS sensor,moisture sensor and/or combinations thereof or other sensors. Detectedmovements or parameters from device's 142 sensor(s), may include (or beused to form) a variety of different parameters, metrics orphysiological characteristics including but not limited to speed,distance, steps taken, and energy expenditure such as calories, heartrate and, sweat detection, effort, oxygen consumed, and/or oxygenkinetics. Such parameters may also be expressed in terms of activitypoints or currency earned by the user based on the activity of the user.Examples of wrist-worn sensors that may be utilized in accordance withvarious embodiments are disclosed in U.S. patent application Ser. No.13/287,064, filed on Nov. 1, 2011, the contents of which areincorporated herein in their entirety for any and all non-limitingpurposes.

FIG. 1C shows illustrative locations for sensory input (see, e.g.,sensory locations 146 a-146 o). In this regard, sensors may be physicalsensors located on/in a user's clothing, yet in other embodiments,sensor locations 402 a-402 o may be based upon identification ofrelationships between two moving body parts. For example, sensorlocation 146 a may be determined by identifying motions of user 124 withan image-capturing device, such as image-capturing device 126. Thus, incertain embodiments, a sensor may not physically be located at aspecific location (such as sensor locations 146 a-146 o), but isconfigured to sense properties of that location, such as withimage-capturing device 126 or other sensor data gathered from otherlocations. In this regard, the overall shape or portion of a user's bodymay permit identification of certain body parts. Regardless of whetheran image-capturing device, such as camera 126, is utilized and/or aphysical sensor located on the user 124, and/or using data from otherdevices, (such as sensory system 202), device assembly 226 and/or anyother device or sensor disclosed herein or known in the art is utilized,the sensors may sense a current location of a body part and/or trackmovement of the body part. In one embodiment, sensory data relating tolocation 146 m may be utilized in a determination of the user's centerof gravity (a.k.a, center of mass). For example, relationships betweenlocation 146 a and location(s) 146 f/146 l with respect to one or moreof location(s) 146 m-146 o may be utilized to determine if a user'scenter of gravity has been elevated along the vertical axis (such asduring a jump) or if a user is attempting to “fake” a jump by bendingand flexing their knees. In one embodiment, sensor location 146 n may belocated at about the sternum of user 124. Likewise, sensor location 146o may be located approximate to the naval of user 124. In certainembodiments, data from sensor locations 146 m-146 o may be utilized(alone or in combination with other data) to determine the center ofgravity for user 124. In further embodiments, relationships betweenmultiple several sensor locations, such as sensors 146 m-146 o, may beutilized in determining orientation of the user 124 and/or rotationalforces, such as twisting of user's 124 torso. Further, one or morelocations, such as location(s), may be utilized to as a center of momentlocation. For example, in one embodiment, one or more of location(s) 146m-146 o may serve as a point for a center of moment location of user124. In another embodiment, one or more locations may serve as a centerof moment of specific body parts or regions.

II. Systems and Methods for Conducting Joint Workouts

Further aspects of this disclosure relate to systems and methods forconducting a joint workout between two or more remote users, such asuser 124 and another individual located at a location that is notviewable from the location user 124 is located.

In one embodiment, user 124 may be located at a first physical location,such as their home, and a second user may be located at a secondphysical location, such as a gym, dwelling, school, or even exercisingoutside, such as running through a city. Yet in another embodiment, user124 may be located in a first area at a first location (e.g., adwelling) and the second user is located at a second area at the samelocation. For example, user 124 may be located in a bedroom of thedwelling and the second user is located in a living room of the samephysical dwelling. In yet another embodiment, at least one of the usersmay be outside and may travel amongst different locations during a jointworkout. For example, the second user may begin the workout at the firstdwelling but travel outside (and possible into another dwelling orstructure) during the joint workout.

Certain aspects of this disclosure relate to a graphical user interface(UI) configured to facilitate a joint session of two or more remoteusers. Despite being at different physical locations, users may stillcompete and/or collectively engage in athletic activities. In oneembodiment, each of a plurality of users may engage in a competition insubstantially real-time. Yet, in other embodiments, a first user mayconduct a predefined series of activities or routines and data from thatfirst user's performance may be utilized in a later conductedcompetition. In one embodiment, two or more users may engage in a“side-by-side” competition. Thus, aspects of this disclosure relate tosystem and methods that may simultaneously present a UI, such as UI 402on two remote display devices in which the users may conduct a jointsession despite being remotely located.

In accordance with one embodiment, computer-executable instructionsstored on a non-transitory computer-readable medium may be configured,such that when executed by a processing unit 106, cause the generationsof a user interface (UI) to be displayed on multiple remote displaydevices. FIGS. 4A-B show an illustrative UI 402 that may be implementedin accordance with various embodiments. As shown in FIG. 4A, UI 402 a isdisplayed on a display device, such as device 136, viewable by the firstuser 124. The generation of various iterations of a user interface maybe based, at least in part, upon athletic movements of two or more userslocated in remote locations. FIG. 5 shows a flowchart 500 that providesone illustrated method that may be utilized in accordance with variousembodiments. The exemplary method of flowchart 500 may be utilized withone or more user interfaces, including but not limited to UI 402 shownin FIG. 6.

In one embodiment, multiple renditions of a user interface (e.g., UI402) may be generated and configured to be displayed at least twodifferent locations or display devices (see, e.g., block 502 of FIG. 5).For example, UI 402 b may be configured to be displayed on a seconddisplay device in the viewable range of a second user. As shown in FIG.4B, UI 402 b shows an illustrative corollary rendition of UI 402 a thatmay be configured to be shown to a second user (not user 124) which maybe at a second location. In certain embodiments, renditions of UI 402a/b may be altered, modified or otherwise adjusted based upon aplurality of factors, including but not limited to, the location of oneor more users, user preference, data obtained from one or more sensors,and combinations thereof. The generation of various iterations of a userinterface may be based, at least in part, upon athletic movements of twoor more users located in remote locations. In certain embodiments,rendition of UI 402 b may be configured to be simultaneously displayedat the second location as the rendition of UI 402 a is provided at thefirst location such that UIs 402 a/402 b are synchronized. As usedherein, “simultaneously” does not exclude delays that are inherent inthe transmission of data between two or more nodes and/or storage ofinformation on a non-transitory computer-readable medium. In thisregard, those skilled in the art will realize that variations in networkspeed, points of congestion, and other inherent delays known in the art.Thus, recitations of simultaneous occurrences includes delays fortransmitting data, including electronic signals instructing one or moreusers to start or stop performing athletic movement. Similarly,references herein the “real-time” occurrences do not require exactprecision and those skilled in the art will realize that inherent delaysmay be present in executing “real-time” actions or occurrences.

Renditions of UI 402 may comprise at least a portion of the sameelements as each other. For example, UI 402 b is shown as havingsubstantially the same (or identical) elements as rendition of UI 402 a.

In accordance with certain embodiments, two or more user users 124/125may be instructed to perform at least one exercise during a jointsession, in which UI renditions 402 a/402 b are shown to the respectiveusers. (See, e.g., block 504 of FIG. 5). One or more embodiments maycomprise a virtual trainer, such as trainers 404 a/404 b, associatedwith UI 402 a/b to provide guidance or instructions to users 124 and125. The rendition of virtual trainer 406 a/406 b (including form,action, appearance and any other feature) may be controlled, at least inpart, according to computer-executable instructions stored on one ormore a non-transitory computer-readable mediums. For example, theattributes of virtual trainer rendition 404 a (including attributes notexplicitly shown in FIGS. 4A-B) may be based on computer-executedinstructions stored on a first computer-readable medium, such as memory108, and attributes of rendition 404 b may be based, at least in partinstructions stored on a second computer-readable medium, which may beremotely located from memory 108. In this regard, each user 124/125 mayhave a different virtual trainer with one or more different virtualqualities. For example, user 124 may select a female trainer while user125 may select a male virtual trainer. In yet other embodiments, one ormore users may have the same virtual trainer (such as a specific femalevirtual trainer), however the trainer's attributes may be altered basedupon the user's movements or preferences. For example, virtual trainer404 a may provide more feedback (such as through a virtual voice) touser 124 and/or may provide further movements or guidance if user 124appears to be struggling with a certain instruction.

Virtual trainer renditions 404 a/404 b may be configured tosimultaneously prompt the remote users to perform a specific exercise.For example, one or more devices may cause the respective displays topresent a virtual trainer rendition 404 a/b demonstrating an exercise toinstruct the users 124/125. For example, renditions 404 a/404 b may eachbe synchronized such that, virtual trainer 404 a is performing the sameathletic movement (or portion thereof) at the same time that virtualtrainer 404 b is performing that athletic movement (or portion thereof).Trainers 404 a/404 b may be configured to simultaneously perform theathletic movement at the same predetermined tempo during the first timeperiod as each other, such that simultaneous actions of users 124/125may be directly correlated. This may further allow detection of how eachuser 124/125 may be performing with respect to the tempo and/or otherattribute of trainer 404 a/404 b.

As one example, virtual trainers 404 may be rendered on the respectivedisplays performing an exercise at multiple positions. Directional cues,such as arrows may be utilized to instruct a user in which direction tomove. UI renditions 402 a/b may be configured to present an animation ofthe virtual trainer 404 a/b demonstrating proper form for performing arepetition of an exercise (e.g., a slow lunge). In addition to, orinstead of, a virtual trainer 404 a/b, the UI 402 a/b may be configuredto present a depiction and/or an actual video of a real persondemonstrating proper form for an exercise.

Form guidance information may also be provided. FIG. 6 provides anexample of one embodiment in which UI 402 provides form guidance. Formguidance information 602 may be presented on (or otherwise associatedwith) the virtual trainer 602 or a graphical representation of user 124when demonstrating an exercise. Form guidance information 602 may be astraight line, an angle between lines, or other information to guide theuser about proper form for an exercise. In FIG. 6, for instance, formguidance information 602 is a straight line across a user's hip bonesinstructing the user to keep their hips level relative to the floor.Form guidance information may be provided through feedback mechanismsthat do not include graphical or textual data overlaid on an avatar,such as virtual trainer 602. In this regard, form guidance informationmay include audio or tactile information. For example, voices or soundsmay provide an indication of how straight a user's hips are (or arenot). In another embodiment, a signal may be provided to a device, suchas sensor device(s) 138, 140, 142 and/or 144 to provide vibrationaloutput configured to be felt by user 124 to provide guidance. Forexample, a vibration may be provided to the sensor device 138 upondetermining that the user's hips are not straight.

In this regard, form guidance provided on UI rendition 402 a may bedifferent than form guidance provided on UI rendition 402 b. In oneembodiment, at least one rendition of UI402 does not comprise any formguidance. In another embodiment, form guidance may be provided basedupon the respective user performance. For example, form guidance may bebased upon one or more of: past user performance, current userperformance, user preferences, goals, parameters of the joint session,and/or a combination thereof among other factors that would beappreciated by a person of skill in the art.

Further aspects of this disclosure relate to generating and updating aUI, such as UI 402, based upon real-time fitness or movement dataobtained from two or more users that are located at different locations(see, e.g., block 506 of FIG. 5). In accordance with one embodiment,various devices (e.g., computer 102) may prompt the users to move into acertain region relative to a device, such as display 136, capturingdevice 126 and/or relative to the sensor 128, so that the user is withinframe and/or range. Prompting of at least one user may be done, forexample, through virtual trainer 404 a. When properly positioned, thesystem 100, through one or more sensors, may process movement of theuser 124. In certain embodiments, the UI rendition 402 a may only showthe graphical representation of the local user (e.g., representation 406a user 124) inclusive of any adjustments based upon the user's real-timemovements and not other graphical representations of other remote users,(e.g., representation 406 b of user 125).

In an example, the system 100 of FIG. 1 may include more than onesensor, such as image capturing device 126, and may capture video fromdifferent perspectives. One or more devices, such as computer 102, mayprocess some or all images and/or infrared data to create one or moreuser avatars as representations 406 a/406 b. In this manner, display 136may present a user's form from multiple angles for the user to observe.Yet, in other embodiments, data for different angles may be derived fromone or more sources. For example, the image capturing device 126 may bepositioned at any desired angle relative to a user performing anexercise, such as, for example, at least one of a front view, left sideview, a right side view, and a back view of a user. In another example,the system 100 may include more than one infrared device 128 to captureinfrared reflections of the user 124 from different perspective. Also,the system 100 may include both an image capturing device 126 and aninfrared transceiver 128 (or more than either one or both) positioned atdifferent/various locations and/or any other sensors disclosed herein,which may be utilized in the generation and/or rendering ofrepresentations 406 a/406 b. Graphical representations 406 a/406 b maybe generated from sensors that lack any image capturing capabilities.For example graphical representation 404 a may be generated from user124 wearing devices 138, 140, 142, and/or 326. In one embodiment,graphical representation 404 a may be generated entirely onaccelerometer and/or gyroscope sensor data. Those skilled in the artwill appreciate that other sensors, alone or in combination, may beutilized to generate graphical representations 406 a/406 b.

Representations 406 a/406 b may be generated or displayed based upon therespective user's real-time movement (See, e.g., block 508 of FIG. 5).For example, user(s) 124/125 may each be positioned in range of asensor, such as in front of the image capturing device 126 and/or sensor128, which may comprise an infrared transceiver. Display 136 may presentUI 402 a comprising representation of user 124 that may be a“mirror-image” or depict a virtual avatar, such as a user avatar, thatmoves to correspond with user movement. A different display may presentUI 402 b to user 125 based on similar factors. A graphicalrepresentation (e.g., representation 406 a of FIG. 4A) of the local usermay be different from the graphical representation configured to bedisplayed to another user. For example, the remote UI rendition 402 b ofFIG. 4B may be configured to be presented to the second user 125 and maybe configured to display representation 406 b (which may be displayed insubstantially the same orientation and/or location as 406 a shown inFIG. 4A), however may represent the second user rather than the firstuser 124. In this regard, various renditions of UI 402 (such asrenditions 402 a/402 b) may comprise only a real-time graphicalrepresentation of the local user and not another user.

Further aspects of this disclosure relate to the simultaneous display ofreal-time image data of a plurality of users associated with the jointsession on a single display device (see, e.g., block 510 of FIG. 5). Forexample, UI rendition 402 a (which may be configured to be displayed touser 124 at the first location) may comprise video data 410 a which isconfigured to display a live video feed of user 124 and video data 412 bwhich is configured to display a live video feed of user 125 located atthe second location. Similarly, UI rendition 402 b may also beconfigured to simultaneously show video data 110 b/112 b. In certainembodiments, 110 a and 110 b and/or 112 a and 112 b may be identical;such as multiple users 124/125 have a live video feed of themselves atleast one remote user. The rendered real-time image data 110 a/110 b maybe provided in combination with or, as an alternative to the display ofthe graphical representations of the users (rendered as 404 a/b) and/orvirtual trainer renditions 406 a/b.

Thus, certain embodiments encompass implementations of a UI 402 arendered to a first user 124 at a first location that includes agraphical representation of that user 124 (e.g., rendition 406 a)displayed simultaneously with image data 410 a of the same user 124 anda second remote user (e.g., image data 412 a of user 125) along with arendered virtual trainer 404 a that instructs the user 124 to perform aspecific physical movement. Simultaneously, the UI 402 may be renderedto a second user 125 located at a second location (rendition 402 b) thatincludes image data of the first and second users 124/125 (see imagedata 410 b and 412 b) and with a rendered virtual trainer 404 b thatinstructs the second user 125 to perform the same physical movement asvirtual trainer rendition 404 a provided to user 124. Therefore, inaccordance with one embodiment, the first rendition of the userinterface 401 a is configured to simultaneously:

-   (1) display virtual trainer 404 a performing the athletic movement    at a first tempo that is synchronized with the tempo of a second    virtual trainer 404 b configured to be displayed simultaneously to a    remote user 125; and-   (2) display the real-time graphical representation of the first user    performing the athletic movement based upon the at least one sensor    at the first location.

Including image data (which may comprise a live feed) of multiple userson the single display device may provide one or more benefits notrealized in the prior art. Seeing image data of another user may providemotivation to work harder or increase the session's duration. Further,users 124/125 may utilize facial expressions or body language todetermine if their competitor or teammate is getting tired or otherwisedetermine their fitness abilities. In certain embodiments, image data110/112, either alone or in combination with audio capabilities, mayprovide increased social aspects. In this regard, increased socialinteractions may provide incentives for remote users to engage inphysical activities, either as a competitive nature, friendly natureand/or as a team.

Further aspects of this disclosure relate to displaying substantiallyreal-time calculations of energy expenditure. Energy expenditure may becalculated by one or more methods. In certain embodiments, energyexpenditure calculations may be based, at least in part, on the sensors,and or environment of the respective user(s). For example, in additionalto processing the images, sensor data, and infrared data, computer 102may receive data from other sources. For example, the user may run apredetermined distance as measured by a sensor attached to the user(e.g., sensor in a shoe) or global positioning system (GPS) device andmay upload the data to computer 102. Computer 102 may compare thecaptured data to desired data for each exercise to monitor the user'sform while performing an exercise. The desired data may include multiplecomparison points throughout an exercise, and/or locations of variousbody parts during the exercise. For example, a push up may be dividedinto four events: (1) the lowest point where the user's chest is nearestto the ground or other reference point and/or their arms are bent at amaximum bend; (2) a highest point where the user's chest is farthestfrom the ground and/or their arms are straightened (e.g., a maximumstraightness); (3) an upward event where the user transitions from thelowest point to the highest point; and (4) a downward event where theuser transitions from the highest point to the lowest point.

The desired data may specify comparison points for each of these eventsfocusing on certain body parts. For example, at each comparison pointduring a pushup, computer 102 may monitor the spacing of the user'shands, the straightness of the user's back, a location of the user'shead relative to their torso, the spacing of the user's feet relative toone another, or other aspects. The desired data may specify desiredlocations for each body part being monitored during comparison pointsfor an exercise, as well as permitted variations from the desiredlocations. If the user's body part varies beyond what is permitted,computer 102 may provide the user with feedback identifying the bodypart and a correction to the user's form (e.g., back is arched, and notstraight, during a pushup). Exemplary methods of determining energyexpenditure are provided in U.S. Provisional Patent Application61/655,365 filed Jun. 4, 2012, the contents which are incorporatedherein by reference in their entirety for any and all non-limitedpurposes.

If an exercise session involves different types of exercises,determinations of points, including but not limited to energyexpenditure points may be based on the type of exercise. The type ofsensors utilized to determine points may fluctuate based upon thespecific exercise and/or the user's performance of the exercise. Infurther embodiments, energy expenditure (e.g., a quantity of caloriesburned) may be ranked as percentage over an ideal value or range for anexercise or routine.

For example, if perfectly performing an exercise would burn about 100calories, a first user who burned 90 calories may be assigned a betterranking than second user who only burned 85 for the same exercise. Theusers could have different ideal values or ranges, thus thedeterminations may utilize the percentage of the detected and/orestimated values as a percentage for that user's ideal value. In furtherembodiments, a user who is closer to 100% of their ideal value may beranked higher than users who have over 100% of the ideal quantity ofcalories burned. In this regard, a user who expends more energy thanestimated or calculated for an activity (e.g., exercise) may indicateimproper movements, inefficiency, increased likelihood of injury, and/orcombinations thereof.

System 100 may also determine calories expended from graphicalrenditions, image data, including, pre-recorded videos or from the imagedata 110/112 b. One or more components of system 100 may process thevideo to determine locations of a center of mass of the player, or ofparticular body parts, at various points in time, and determine theamount of calories expended during the physical activity (e.g., by theplayer during the dunk) using the work-based calorie determination,described above.

In accordance with one embodiment, calculated energy expendituredeterminations based upon the respective users 124/125 real-timeperformances may be simultaneously displayed on a user interface (seee.g., block 512 of FIG. 5). As one example, interface 414 a may comprisea real-time indication of energy expenditure of user 124 (and interface414 b may be the same indication shown on rendition 402 b). For example,interface 414 may comprise energy expenditure values 416. In oneembodiment, value 416 may represent a calculated energy expenditurevalue and/or other value of a point system specific to the physicalmovements of user 124. Interface 418 a may be simultaneously displayedwith interface 414 a and comprise a calculated value (e.g., value 420 a)associated with the movements of user 125. For example, in certainembodiments, interfaces 414 a and 418 a may be updated in real-time toreflect values (such as an energy expenditure value) associated with therespective movements of users 124 and 125 responsive to the instructionsprovided by virtual trainers 404 a and 404 b. Thus, according to certainimplementations, a plurality of users (e.g., users 124/125) may readilyview not only which user has the highest value, or the energy expendedper unit time, but also determine how close the other user's value is totheirs, whether the other user(s) are getting closer or further, and/ordeterminations relating to other users performances on specificroutines. As seen in the illustrative embodiment, interfaces 414 and 418may be provided on a single interface (e.g., interface rendition 402 acomprises 414 a and 418 a), however, the interfaces may be located indifferent areas of UI 402 for specific renditions, such as renditions402 a and 402 b. Further, the appearance and/or operation of interface414 and/or 418 or any other element of UI 402 may be different amongstdifferent renditions.

In certain embodiments, a graphical indication may be associated withthe user(s) who currently has the highest quantity of points (see, e.g.,indication 422). In certain embodiments, indication 222 or anotherindication may be utilized to indicate the user(s) earning the mostpoints per unit time, points awarded for difficult movements, bestperformance of a specific movement, matching the form, tempo or otherattribute set forth by the virtual trainer or combinations thereof.

Still yet further embodiments, an interface, such as interface 224,configured to display a joint total of points determined from the jointmovements of at least two users, such as users 124 and 125. In theillustrative embodiment, interface 424 a comprises value 426 which iscalculating from combining the points of user 124 (set forth ininterface 414 a) and user 125 (set forth in interface 418). Value 426may be updated in real-time (see, e.g., block 514 of FIG. 5). Althoughinterface 224 is shown separate from interface 414 and 418, thoseskilled in the art will appreciate that interface 424 or any otherelement may be part of another interface, such as any other elementsdisclosed herein.

For example, looking to FIG. 4A, rendition 404 a comprises meter 428 a.FIG. 7 is a flowchart of an exemplary method of selecting and updating ameter in accordance with one embodiment. As one example, meter 428 a maybe selected based upon the type of athletic movement demonstrated byvirtual trainer 404 a (see, block 702 of FIG. 7). In one embodiment, ifthe activity to be demonstrated by trainer 404 (and/or performed by user124) is known or considered to be a good indication of measuringcardiovascular health, then cardio meter 428 a may be displayed on UI402 a/402 b during the user's 124 performance of the activity (see also,meter 428 b shown remotely on FIG. 4B). Similarly, meter 430 a may besimultaneously displayed on UI rendition 404 a to user 124. Meter 430 amay relate to the performance of the athletic activity by user 125.

Meters 430 a/430 b are not limited to cardio meters. For example, in oneembodiment, if the predetermined athletic activity is considered orknown to be a good indication of measuring strength, then a strengthmeter may be selected for display on UI 402 a/402 b during the user'sperformance of the activity. Those skilled in the art will readilyappreciate that a strength meter and a cardio meter are merely examples,and that other meters may be among the plurality of meters. Block 704may be implemented to adjust, alter, or entirely change the displayproperties of the selected meter. In this regard, block 704 may beimplemented to perform one or more of: determine which renditions of UIare configured to display the selected meter, whether the selected meteris the only meter, selection of an additional meter, and combinationsthereof. In certain embodiments, more than one meter may besimultaneously displayed on UI 402 a/402 b. For example, either bydefault, user preference, and/or other factors, a strength meter and acardio meter may each be configured to be simultaneously displayed on atleast one user's rendition of UI 402.

In one embodiment, a user 124 may determine which meter is shown on eachuser's UI 402 (which may occur as part of blocks 702 and/or 704). Forexample, if it is decided (either by default computer-executableinstructions, or indirectly through user input) that a “winner” of aspecific competition between two or more users is to be decidedaccording to a specific attribute (e.g., strength, cardio, fitness,athleticism, speed, tempo, etc.), then a specific meter may be selectedbased upon this determination. In certain embodiments, scoring may bebased upon scaling or otherwise combining multiple attributes,therefore, multiple meters may be available for selection (orautomatically selected).

In yet another embodiment, selections (such as part of block(s) 702/704)may be based upon a user's performance. For example, if user 124 is“winning,” such as by having a higher cumulative value of energyexpenditure points (which may be updated in real-time as value 416),then the selection and/or display properties of a meter may be basedupon this. For example, if user 124 is currently performing better thana remote user 125 as measured by “strength” but not “cardio,” then thestrength meter may be selected for display. In yet another embodiment,user 124 may select a specific meter to be shown based upon apre-inputted user input.

In one embodiment, a plurality of different meters may each relate to asingle user's performance. For example, a strength meter and a cardiometer specific to a user's performance may be simultaneously displayedon rendition 404 a. The displaying and updating of one or more meters428 a specific to a single user's performance may be simultaneouslydisplayed on the same UI rendition 404 a with one or more metersspecific to a remote user's 125 performance. Further, in certainembodiments, certain meters may be selectable to be displayed only on alocal user's UI rendition 402 a. However, in other embodiments, both UIrenditions 402 a/402 b may comprise the selected meter(s). Users 124/125may be permitted to select which meters 428/430 are displayed to anotheruser 124/125.

The meter(s) may be updated in real-time as the users perform thepredetermined athletic activity (see, e.g., block 706). Thus in certainembodiments, each of a plurality of users remotely located from at leastone other user may compare their performance with at least one otheruser. The updating of the meter(s) 428/430 may be based upon sensordata, such as described herein. In one embodiment, the properties of atleast the first selected meter may be based upon data received from theat least one sensor located at the first location and simultaneouslyaltering the properties of the second selected meter based upon datareceived from the at least one sensor at the second location.

FIGS. 8A-B show example meters that may be utilized in accordance withvarious embodiments disclosed herein. Specifically, FIG. 8A shows anexample cardio meter 802 and FIG. 8B shows an example strength meter804. Although the examples are discussed in the context of illustrativemeters 802/804, those skilled in the art will appreciate that othermeters may be implemented without departing from the scope of thisdisclosure. One or more of meters 802/804 may be configured to bedisplayed on UI renditions 402 a/402 b, such as for example but notlimited to interface(s) 414/418. As such other values, such as energyexpenditure values 416/420 or other points may be displayed proximate toone or more of meters 802/804, including on the same interface 414/418.

In one embodiment, cardio meter 802 (which is usually the blue bar shownbelow) may comprise a measuring bar 806 (or other structure or shape)that may “fill” or otherwise be visually adjusted based on an intensityattribute of the user's physical movements. The adjustment of measuringbar 806 may be directly based upon data received from sensors at theuser's location. For example, in one embodiment, the movement ofmeasuring bar 806 may be based upon the local user's movement intensity.In one embodiment, the more user 124 moves, the more measuring bar 806will fill. In one embodiment, the movement of measuring bar 806 may bedirectly correlated to energy expenditure. In one such embodiment,energy expenditure value 416 a may be directly correlated to themovement of measuring bar 806. In another embodiment, energy expenditurevalue 416 a may be a cumulative tally of energy expenditure for aspecific workout or portion thereof having a first time frame (such as 5minutes), and measuring bar 806 may be correlated to energy expendituredirected towards a second time frame, which may be inclusive and/oroverlap with the first time frame. For example, measuring bar 806 couldprovide feedback on the current real-time energy expenditure (e.g. thelast second or few seconds) and thus be an indicator of explosiveness.In yet other embodiments, measuring bar 806 may provide feedback on adifferent period of time.

In other embodiments, energy expenditure value 416 a and measuring barmay each relate to energy expenditure, however, are not correlated. Forexample, one of energy expenditure value 416 a or measuring bar 806 maybe configured to measure energy expenditure during an athletic movement(or multiple movements) while the other measures only those expendituresfitting a specific criteria. For example, UI 402 may be configured suchthat the measuring bar 806 (or value 416 a) may only be updated todisplay energy expenditure (or another attribute) based on propermovements. For example, if a virtual trainer 404 a is instructing user124 to perform a lunge and user 124 is performing a push up, at least aportion of user's 124 movements may not be considered in updating one ormore meters or values. Similarly, the timing of the user's 124 movementsmay reflect which, if any values, such as value 416 a, or meters, suchas meters 802/806 are updated to reflect the actual movement. Forexample, if trainer 404 a instructs user 124 to perform jumping jacks ata rate of 1 jumping jack per 2 seconds and the user is performingjumping jacks at the rate of 1 per 4 seconds, then at least one meter orvalue may be updated such that at least some of the movements are notconsidered or are scaled by a scaling factor. As would be appreciated bythose skilled in the art, value 416 a may not be displayed and thediscussion above applies equally to the functionality of meter 802 (ormeter 804) even when displayed alone.

An area or length of measuring bar 806 may be based on a predeterminedtotal. For example, a maximum value (e.g., filling of the entiremeasuring bar) may be based on one or more factors, such as but notlimited to being 1) based upon user-specific data or 2) a universalstandard. In this regard, certain users may be “handicapped” such thatthe display properties of meter 802/804 may be altered based upon theirperformance level.

Meter 802 (and/or another meter, such as meter 806) may comprise one ormore markets associated with the measuring bar 804 or other property ofthe respective marker. For example, illustrative meter 802 comprisesthree arrowheads located on the lower portion of meter 802 (shown asarrowheads 808 a, 808 b, and 808 c). In one embodiment, each successivearrowhead may represent a threshold. In certain embodiments, users maywish to perform at a certain performance level and thus the arrowheads808 a-808 c may serve as a visual indication as such. For example,following performance of the athletic movement, computer-executableinstructions may be executed to determine a performance level. In oneembodiment, there may be for example 3 performance levels. Thus, in oneembodiment, each successive arrowhead going from the left-most arrowhead(808 a) towards the right-most arrowhead (808 c) provides thresholdlevels for obtaining the next performance level.

In certain embodiments, a user may need to only pass the threshold setby the respective arrowhead, yet in other embodiments; the user mustobtain a certain amount of time as being above a certain threshold levelto obtain a reward of obtaining the next performance level. For example,the measuring bar 806 above the arrowheads 808 a-808 c may indicate themaximum value (e.g., a maximum energy expenditure value) that may beachieved for that specific movement (e.g., squat) and as the userconducts each of a plurality of successive squats, the measuring bar 806fills and passes each of the three different thresholds set by thearrowheads 808 a-808 c. In another embodiment, the arrowheads 808 a-808c may be used to indicating three different portions of the movement,such as each arrowhead may be correlated to a user conducting adifferent portion of the movement (e.g., moving downward, pausing, andthen straightening back to an upward position). In one embodiment, aportion of measuring bar may be left unfilled, such as the portionbetween 808 a-808 b if a user did not meet a threshold level during therespective time period. Thus, in this respect, measuring bar may beviewed as a plurality of bars that each measure a specific period oftime during a movement or among a plurality of successive movements.

Looking to FIG. 8B, meter 804 may be a strength meter configured todisplay (on one or more UI renditions, such as 402 a and/or 402 b), anindication of a user's performance based upon data from one or moresensors. Meter 804 may comprise a plurality of markers, such as theplurality of circular-shaped markers 810 a-810 c. In one embodiment,markers 810 a-810 c may serve one or more functions to those describedin relation to markers 808 a-808 c discussed above in relation to FIG.8A. In one embodiment, each successive marker (or a group of markers)may represent a threshold. In certain embodiments, users may wish toperform at a certain performance level and thus the markers 810 a-810 cmay serve as a visual indication as such. In one embodiment, thedetermination of strength of a user may be determined according to theirform as measured by one or more sensors. In this regard, a user's formduring an athletic movement, such as a lunge or reps of lunges, may becompared to the ideal form. The ideal form may be demonstrated by avirtual trainer 404 a that is simultaneously displayed on one or more UIrenditions 404 a/404 b. In this regard, the virtual trainer may beperforming the athletic activity at a predetermined tempo, thus thetiming of the user's form may be considered in the determination of theattribute (e.g., strength) that may be simultaneously displayed at thelocal and remote UI renditions 404 a/404 b.

Similar to the discussion of the cardio meter 802, each marker (e.g.,810 a-810 c) may represent the user's cumulative strength or strengthfor successive portions or reps of athletic movements. Although meters802 and 804 are described in context of a cardio and strength meters,respectively, those skilled in the art would readily appreciate thateither meter may be modified to serve as the other without undoexperimentation. For example, the bar of the cardio meter 802 couldserve as the markers of meter 804 and vice-versa.

The invention claimed is:
 1. A computer-implemented method executed by aprocessor, the method comprising: generating, by the processor, a firstrendition of a user interface, the first rendition comprising a firstprompt instructing a first user at a first location to perform anathletic movement during a first time period, the first renditionconfigured to display a graphical representation of the first userperforming the athletic movement; generating, by the processor, a secondrendition of the user interface, the second rendition comprising asecond prompt instructing a second user at a second location to performthe athletic movement during the first time period, the second renditionconfigured to display a graphical representation of the second userperforming the athletic movement; receiving, by the processor and whilethe first user and the second user are performing the athletic movement,first data from at least one sensor at the first location and seconddata from at least one sensor at the second location; calculating, bythe processor and based on the first data and the second data, and for aplurality of time frames within the first time period, first energyexpenditure values for the first user and second energy expenditurevalues for the second user; calculating, by the processor, a jointenergy expenditure value based on the first energy expenditure valuesand the second energy expenditure values; comparing, by the processor,the first energy expenditure values and the second energy expenditurevalues; based on the comparing, automatically selecting, by theprocessor and from a plurality of activity meters, a specific activitymeter; and displaying, by the processor and on the first rendition ofthe user interface and the second rendition of the user interface, thejoint energy expenditure value and the specific activity meter.
 2. Thecomputer-implemented method of claim 1, further comprising: displaying,in real-time and on the first rendition and on the second rendition, thefirst energy expenditure values for the first user and the second energyexpenditure values for the second user.
 3. The computer-implementedmethod of claim 1, wherein displaying the joint energy expenditure valuecomprises displaying the joint energy expenditure value in real-time. 4.The computer-implemented method of claim 1, further comprising:determining, during the first time period, which of the first or thesecond user has a higher energy expenditure value, and altering, inreal-time, the first rendition and the second rendition to indicatewhich of the first user or the second user has the higher energyexpenditure value.
 5. The computer-implemented method of claim 1,further comprising: displaying, on the first rendition and the secondrendition, first real-time image data of the first user performing theathletic movement, and second real-time image data of the second userperforming the athletic movement.
 6. The computer-implemented method ofclaim 1, further comprising: determining, from a strength meter or acardio meter, a selected meter to be displayed on the first renditionand on the second rendition; displaying, on the first rendition and onthe second rendition, a first selected meter indicating a firstperformance of the first user of the athletic movement and a secondselected meter indicating a second performance of the second user of theathletic movement; and in real-time, altering properties of the firstselected meter based upon data received from the at least one sensorlocated at the first location and simultaneously altering properties ofthe second selected meter based upon data received from the at least onesensor at the second location.
 7. The computer-implemented method ofclaim 6, wherein determining the selected meter comprises determiningthe selected meter based on a user input from one of the first user andthe second user.
 8. One or more non-transitory computer readable mediastoring computer-executable instructions that, when executed by at leastone processor, causes the at least one processor to: generate a firstrendition of a user interface, the first rendition comprising a firstprompt instructing a first user at a first location to perform anathletic movement during a first time period, the first renditionconfigured to display a graphical representation of the first userperforming the athletic movement; generate a second rendition of theuser interface, the second rendition comprising a second promptinstructing a second user at a second location to perform the athleticmovement during the first time period, the second rendition configuredto display a graphical representation of the second user performing theathletic movement; receive, while the first user and the second user areperforming athletic movement, first data from at least one sensor at thefirst location and second data from at least one sensor at the secondlocation; calculate, based on the first data and the second data, andfor a plurality of time frames within the first time period, firstenergy expenditure values for the first user and second energyexpenditure values for the second user; calculate a joint energyexpenditure value based on the first energy expenditure values and thesecond energy expenditure values; compare the first energy expenditurevalues and the second energy expenditure values; based on the comparing,automatically select, by the at least one processor and from a pluralityof activity meters, a specific activity meter; and display, on the firstrendition of the user interface and the second rendition of the userinterface, the joint energy expenditure value and the specific activitymeter.
 9. The one or more non-transitory computer readable media ofclaim 8 storing computer-executable instructions that, when executed bythe least one processor, causes the at least one processor to: display,in real-time and on the first rendition and on the second rendition, thefirst energy expenditure values for the first user and the second energyexpenditure values for the second user.
 10. The one or morenon-transitory computer readable media of claim 8, wherein displayingthe joint energy expenditure value comprises displaying the joint energyexpenditure value in real-time.
 11. The one or more non-transitorycomputer readable media of claim 8 storing computer-executableinstructions that, when executed by the least one processor, causes theat least one processor to: determine, during the first time period,which of the first or the second user has a higher energy expenditurevalue, and alter, in real-time, the first rendition and the secondrendition to indicate which of the first user or the second user has thehigher energy expenditure value.
 12. The one or more non-transitorycomputer readable media of claim 8 storing computer-executableinstructions that, when executed by the least one processor, causes theat least one processor to: display, on the first rendition and thesecond rendition, first real-time image data of the first userperforming the athletic movement, and second real-time image data of thesecond user performing the athletic movement.
 13. The one or morenon-transitory computer readable media of claim 8 storingcomputer-executable instructions that, when executed by the least oneprocessor, causes the at least one processor to: determine, from astrength meter or a cardio meter, a selected meter to be displayed onthe first rendition and on the second rendition; display, on the firstrendition and on the second rendition, a first selected meter indicatinga first performance of the first user of the athletic movement and asecond selected meter indicating a second performance of the second userof the athletic movement; and in real-time, alter properties of thefirst selected meter based upon data received from the at least onesensor located at the first location and simultaneously alteringproperties of the second selected meter based upon data received fromthe at least one sensor at the second location.
 14. An apparatuscomprising: at least one processor; and memory storing instructionsthat, when executed by the at least one processor, cause the apparatusto: generate a first rendition of a user interface, the first renditioncomprising a first prompt instructing a first user at a first locationto perform an athletic movement during a first time period, the firstrendition configured to display a graphical representation of the firstuser performing the athletic movement; generate a second rendition ofthe user interface, the second rendition comprising a second promptinstructing a second user at a second location to perform the athleticmovement during the first time period, the second rendition configuredto display a graphical representation of the second user performing theathletic movement; receive, while the first user and the second user areperforming athletic movement, first data from at least one sensor at thefirst location and second data from at least one sensor at the secondlocation; calculate, based on the first data and the second data, andfor a plurality of time frames within the first time period, firstenergy expenditure values for the first user and second energyexpenditure values for the second user; calculate a joint energyexpenditure value based on the first energy expenditure values and thesecond energy expenditure values; compare the first energy expenditurevalues and the second energy expenditure values; based on the comparing,automatically select, by the at least one processor and from a pluralityof activity meters, a specific activity meter; and display, on the firstrendition of the user interface and the second rendition of the userinterface, the joint energy expenditure value and the specific activitymeter on the first rendition and one the second rendition.
 15. Theapparatus of claim 14, the memory storing instructions that, whenexecuted by the at least one processor, cause the apparatus to: display,in real-time and on the first rendition and on the second rendition, thefirst energy expenditure values for the first user and the second energyexpenditure values for the second user.
 16. The apparatus of claim 14,wherein displaying the joint energy expenditure value comprisesdisplaying the joint energy expenditure value in real-time.
 17. Theapparatus of claim 14, the memory storing instructions that, whenexecuted by the at least one processor, cause the apparatus to:determine, during the first time period, which of the first or thesecond user has a higher energy expenditure value, and alter, inreal-time, the first rendition and the second rendition to indicatewhich of the first user or the second user has the higher energyexpenditure value.
 18. The apparatus of claim 14, the memory storinginstructions that, when executed by the at least one processor, causethe apparatus to: display, on the first rendition and the secondrendition, first real-time image data of the first user performing theathletic movement, and second real-time image data of the second userperforming the athletic movement.
 19. The apparatus of claim 14, thememory storing instructions that, when executed by the at least oneprocessor, cause the apparatus to: determine, from a strength meter or acardio meter, a selected meter to be displayed on the first renditionand on the second rendition; display, on the first rendition and on thesecond rendition, a first selected meter indicating a first performanceof the first user of the athletic movement and a second selected meterindicating a second performance of the second user of the athleticmovement; and in real-time, alter properties of the first selected meterbased upon data received from the at least one sensor located at thefirst location and simultaneously altering properties of the secondselected meter based upon data received from the at least one sensor atthe second location.
 20. The apparatus of claim 19, wherein determiningthe selected meter comprises determining the selected meter based on auser input from one of the first user and the second user.